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PRODUCING AUTOMATIC "PAINTING" EFFECTS IN IMAGES 

Field of the Invention 

The present invention relates to an image processing 
method and apparatus and, in particular, discloses a Producing 
Automatic "Painting" Effects in Images. 

The present invention further relates to the field of 
image processing and in particular to producing artistic 
effects in images. 
Background of the Invention 

Recently, it has become quite popular to provide filters 
which produce effects on images similar to popular artistic 
painting styles. These filters are designed to take an image 
and produce a resultant secondary image which appears to be an 
artistic rendition of the primary image in one of the artistic 
styles . 

One extremely popular artist in modern times was Vincent 
van Gogh. It is a characteristic of art works produced by this 
artist that the direction of brush strokes in flat areas of his 
paintings strongly follow the direction of edges of dominant 
features in the painting. For example, his works entitled 
"Road with Cypress and Star", "Starry Night" and "Portrait of 
Doctor Gachet" are illustrative examples of this process. 

It would be desirable to provide a computer algorithm 
which can automatically produce a "van Gogh" effect on an 
arbitrary input image. 
Summary of the Invention 

It is an object of the present invention to produce 
automatic "van Gogh" type effects in images. 

In accordance with the first aspect of the present 
invention there is provided a method of automatically 
processing an image comprising locating within the image 
features having a high spatial variance and stroking the image 
with a series of brush strokes emanating from those areas 
having high spatial variance. 

Preferably, the brush strokes have decreasing sizes near 
important features of the image. 

Additionally, the position of a predetermined portion of 
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brush strokes can undergo random jittering. 
Brief Description of the Drawings 

Notwithstanding any other forms which may fall within the scope 
of the present invention, preferred forms of the invention will 
now be described, by way of example only, with reference to the 
accompanying drawings which: 

Fig. 1 illustrates the major steps in the preferred 
embodiment ; 

Fig. 2 illustrates the Sobel filter co-efficients utilised 
within the preferred embodiment; 

Figs. 3 & 4 illustrate the process of offsetting curves 
utilised in the preferred embodiments; 
Description of the Preferred and Other Embodiments 

The preferred embodiment is preferable implemented through 
suitable programming of a hand held camera device such as that 
described in Australian Provisional Patent Application entitled 
"Image Processing Method and Apparatus ( ART01 ) " filed 
concurrently herewith by the present applicant the content of 
which is hereby specifically incorporated by cross reference. 

The aforementioned patent specification discloses a camera 
system, hereinafter known as an "Artcam" type camera, wherein 
sensed images can be directly printed out by an Artcam portable 
camera unit. Further, the aforementioned specification 

discloses means and methods for performing various 
manipulations on images captured by the camera sensing device 
leading to the production of various effects in any output 
image. The manipulations are disclosed to be highly flexible 
in nature and can be implemented through the insertion into the 
Artcam of cards having encoded thereon various instructions for 
the manipulation of images, the cards hereinafter being known 
as Artcards. The Artcam further has significant onboard 
processing power by an Artcam Central Processor unit (ACP) 
which is interconnected to a memory device for the storage of 
important data and images . 

In the preferred embodiment there is described an 
algorithm which will automatically convert a photographic image 
into a "painted' 1 rendition of that image which replaces groups 
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of pixels in the input image with "brush strokes" in the output 
image. The algorithm works by automatically detecting dominant 
edges and propagating the edge direction information into flat 
areas of the image so that brush strokes can be oriented in 
such a way as to approximate the van Gogh style. The algorithm 
is suitable for implementation on the aforementioned Artcam 
device . 

Turning initially to Fig. 1, the algorithm comprises a 
number of steps 1. These steps include an initial step of 
filtering the image to detect its edges 2. Next, the edges are 
thresholded or "skeletonised" 4 before being processed 5 to 
determine the final edges 6. Bezier curves are then fitted to 
the edges. Next, the curves are offset 7 and brush strokes are 
placed on final image 8. The process 7 and 8 is iterated until 
such time as the image is substantially covered by brush 
strokes. Subsequently, final "touching up" 9 of the image is 
performed. 

Turning now to describe each step in more detail. In the 
first step 2 of filtering to detect edges, a Sobel 3x3 filter 
having co-efficient sets 12 and 13 as illustrated in Fig. 2 can 
be applied to the image. The Sobel filter is a well known 
filter utilised in digital image processing and its properties 
are fully discussed in the standard text "Digital Image 
Processing" by Gonzalez and Woods published 1992 by the Addison 
- Wesley publishing company of Reading, Massachusetts at pages 
197-201. The Sobel derivative filter can be applied by either 
converting the image to greyscale before filtering or filtering 
each of the colour channels of an image separately and taking 
the maximum. The result of Sobel filtering is the production 
of a greyscale image indicating the per-pixel edge strength of 
the image . 

Next, the resultant per-pixel edge strength image is 
thresholded 3 so as to produce a corresponding thresholded 
binary image. The threshold value can be varied however, a 
value of 50% of the maximum intensity value is suitable. For 
each pixel in the edge strength image the pixel is compared 
with the threshold and if it is greater than the threshold a 
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xx one" is output and if it is less than the threshold a "zero" 
is output. The result of this process is to produce a 
threshold edge map. 

Next, the thresholded edge map is "skeletonised" at step 4 
of Fig. 1. The process for skeletonising an image is fully set 
out in the aforementioned reference text at pages 491-494 and 
in other standard texts. The process of skeletonisation 
produces a "thinned" skeletonised edge map maintaining a 
substantial number of characteristics of the thresholded edge 
map . 

In a next step the edges of the skeletonised edge map are 
determined to yield a data structure which comprises a list of 
further lists of points within the image. Preferably, only 
edges having a length greater than a predetermined minimum are 
retained in the list. 

As the skeletonised image contains only single-pixel-width 
edges, possibly with multiple branches, the following algorithm 
expressed as a C++ code fragment sets out one method of 
determining or identifying the points which belong to each 
contiguous edge in the skeletonised image. It breaks branching 
edges into separate edges, and chooses to continue along the 
edge in the direction which minimises the curvature of each 
branch - ie. at a branch-point it favours following the branch 
which induces the least curvature. The code is as follows: 
void 

FollowEdges 
( 

Image& image , 

int minimumEdgeLength, 

PointListList& pointLis tList 

) 
( 

pointListList . Erase ( ) ; 

for (int row = 0; row < image . Height () ; row++) 
{ 

for (int col = 0; col < image .Width () ; col++) 
{ 
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If (image [row] [col] > 0) 
{ 

PointList pointList ,- 

// append the starting point to the point 

list , 

// and clear it so we don't find it again 
pointList .Append (Point (col , row) ) ; 
image [row] [col] = 0; 

// follow the edge from the starting point 

to its beginning 

FollowEdge (row, col, image, pointList); 
// reverse the order of the points 
// and follow the edge from the starting 
pointList . Reverse { ) ; 

FollowEdge (row, col, image, pointList); 

// keep the point list only if it's long 
enough 

if (pointList . Size ( ) >= minimumEdgeLength) 
pointLis tList . Append (pointList ) ; 

} 

} 

} 

} 

// table of row and column offsets to eight surrounding 
neighbours 

// (indexed anti-clockwise, starting east) 

static int of f setTable [ 8 ] [2] = 

{ 

{0, 1}, {-1, 1}, {-1, 0}, {-1, -1}, {0, -1}, {1, -1}, {1, 
0}, {1,1} 
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}; 

// table of preferred neighbour checking orders for given 
direction 

// (indexed anti-clockwise, starting east favouring non 
diagnals ) 

static int nextDirTable [8] [8] = 
{ 



{0, 


2, 


6, 


1, 


7, 


3, 


4, 


5) , 


{2, 


0, 


1, 


3, 


7, 


4, 


5, 


6) , 


{2, 


4, 


0, 


3, 


1, 


5, 


6, 


7}, 


{4, 


2, 


3, 


5, 


1, 


6, 


7 , 


0) , 


{4, 


6, 


2, 


5, 


3, 


7, 


0, 


1} , 


{6, 


4, 


5, 


7, 


3, 


0, 


1, 


2) , 


{6, 


0, 


4, 


7, 


5, 


1, 


2, 


3}, 


{0, 


6, 


7, 


1, 


5, 


2, 


3, 


4) , 



}; 

void 

FollowEdge 
( 

int row, 
int col, 
Image& image, 
PointList& pointList 

) 
{ 

Vector edgeHistory [EDGE_HISTORY„SIZE] ; 
int historylndex - 0 ; 

for (;;) 
{ 

// table of pre-computed 

// compute tangent estimate from edge history 
Vector tangent; 

for (int i = 0; i < EDGE_HI STORY_S I ZE ; i++) 
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tangent += edgeHistory [ i ] ; 
// determine tangent angle and quantize to eight 

directions 

// (direction zero corresponds to the range -PI/ 8 to 
+PI/8, i.e east) 

double realAngle = tangent .Angle () ; 

int angle = (int) ((realAngle * 255) / (2 * PI) + 

0.5) ; 

int dir = ({angle - 16 + 256) % 256) / 32; 

// try surrounding pixels, fanning out from 

preferred 

// (i.e. edge) direction 

int* pNextDir = nextDirTable [dir ] ; 

bool bFound = false; 

for (i = 0; i < 8; i++) 
{ 

// determine row and column offset for 

current direction 

int rowOffset = of f setTable [dir ][ 0 ] ; 
int colOffset = of f setTable [dir ][ 1 ] ; 

// done testing neighbours if edge pixel 

found 

if (image [row + rowOffset] [col + 

colOffset] > 0) 

{ 

// determine edge pixel address 

Point oldPoint (col, row) ; 

row + = rowOffset; 

col += colOffset; 

Point newPoint (col, row) ; 

// update edge tangent history 
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tangent = newPoint - oldPoint; 
tangent . Normalize ( ) ; 

edgeHistory [histroylndex] = tangent; 
historylndex - (historylndex +1) % 

EDGE_HISTORY_SIZE; 

// append edge pixel to point list 
pointList .Append (newPoint ) ; 

// clear edge pixel, so we don't find 

it again 

image [row] [col] = 0; 
bFound = true; 
break; 

} 

// determine next direction to try 
dir = pNextDir[i]; 



// done following edge if no edge pixel found 
if (! bFound) 
break; 



The result of utilising this algorithmic component on the 
skeletonised edgemap is to produce a list of edges having at 
least a predetermined size. A suitable size was found to be a 
length of 20 pixel elements. 

In the next step 6 of Fig. 1, Bezier curves are fitted to 
each of the edge lists derived from step 5. For each list of 
edges, a piece wise Bezier curve is fitted to the corresponding 
list of points. A suitable algorithm for fitting the piece 
wise Bezier curve is Schneider's curve fitting algorithm as set 
out in Schneider, P.J., "An Algorithm for Automatically Fitting 
Digitised Curves in Glassner , A . S . (Ed.), Graphics Gems, 
Academic Press, 1990. This algorithm provides quick 
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convergence to a good fit which aims only for geometric 
continuity and not parametric continuity. Schneider's 
algorithm is recursive, such that if the fit is poor, is sub- 
divides the curve at the point of maximum error and fits the 
curves to the two halves separately. Next an estimate of the 
tangent at the split point is derived using only the two points 
on either side of the split point. For dense point sets, this 
tends to amplify the local noise. An improved quality of curve 
fitting can be alternatively undertaken by using points further 
away from the split point as the basis for the tangent. 

In the next steps 7 of Fig. 1, the curves are offset from 
the primary curve list by half a desired "brush stroke width" . 
The offsetting occurring on both sides of the primary curve 
list with the result being two curves approximately one stroke 
width apart from one another which run parallel to and on 
either side of the original primary curve. 

The following algorithm is utilized to generate a piece 
wise Bezier curves which are approximately parallel to a 
specified piece wise Bezier curves and includes the steps. 

i. Create an empty point list. 

ii. Create and empty tangent (vector) list. 

iii. Evaluate selected points on each curve segment making 
up the piece-wise curve and offset them by the specified offset 
value. Append the offset points to the point list, and their 
corresponding tangents to the tangent list. This process is 
described below with reference to Fig. 2 and 3. 

iv. Fit a piece-wise Bezier curve to the resultant point 
list. Rather than estimating tangents during the curve-fitting 
process, use the exact tangents associated with the offset 
points . 

Offset each curve segment as follows: 

i. Evaluate the curve value, normalised tangent and 
normalised normal normalised to the size of the image for a set 
of evenly-spaced parameter value between (and including) 0.0 
and 1.0 (eg. a spacing of 0.25). 

ii. Scale the normals by the specified offset value. 

iii. Construct line segments using the curve points and 
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scaled normals. 

iv. If any two line segments intersect, eliminate the 
point associated with one of them. 

v. Append the surviving points to the point list, and 
append their corresponding tangents to the tangent list. Only 
append the point associated with parameter value 1.0 if the 
segment in question is the last in the piece-wise curve, 
otherwise it will duplicate the point associated with parameter 
value 0.0 of the next segment . 

The process of offsetting each curve segment can proceed 
as following : 

1. Firstly, for a set of evenly spaced parameter values 
on the Bezier curve between (and including) 0.0 and 1.0, for 
each parameter value PN (Fig. 3) the curve value 3 0 a 
normalised tangent 31 and normalised normal 32 are calculated. 

2. Next, the normals 32 are scaled 34 by a specified 
offset value. 

3. Next a line segment from the point 3 0 to a point 36, 
which is at the end of the scaled normal 34 is calculated. 

4. Next, the line segment 30, 3 6 is checked against 
corresponding line segments for all other points on the curve 
eg. 38, 39. If any two line segments intersect, one of the 
points 36 is discarded. 

5. The surviving points are appended to the point list 
and their corresponding tangents are appended to the tangent 
list. The point associated with the parameter value 1.0 is 
appended only if the segment in question is the last in the 
piece-wise curve segment. Otherwise, it will duplicate the 
point associated with the parameter value 0.0 of the next 
segment . 

Turning to Fig. 4, the end result of the offset of curves 
in accordance with step 7 of Fig. 1 is to produce for a series 
of Bezier curve segments CI, C2 etc. Firstly, a series of 
parametrically spaced points, PI - P5 . Next, the normalisation 
points Nl - N5 are produced (corresponding through to point 3 6 
of Fig. 3), for each of the points Pi - P5 . Next, the 
resultant piece-wise Bezier curve segment 40 is produced by 
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utilising the points in 1 - N5 . This process is then repeated 
for the opposite curve comprising the points N6 - N10 and curve 
41. This process is then repeated for each of the subsequent 
piece-wise curves C2 etc. The result is the two curves of 40, 
41 being substantially parallel to one another and having a 
spaced apart width of approximately one brush stroke. 

Next, a series of brush strokes are placed into the output 
image along the curves. The strokes are oriented in accordance 
with the curve tangent direction. Each brush stroke is defined 
to have a foot print which defines where it may not overlap 
with other brush strokes. A brush stroke may only be place 
along the curve if its foot print does not conflict with the 
foot prints already present in the output image. Any curves 
that do not have any brush strokes placed along them are 
discarded and the process of steps 7 and 8 are iterated in a 
slightly modified form until no curves are left. The slightly 
modified form of step 7 is to offset the curves by one brush 
stroke in the outward direction rather than the half brush 
stroke necessary when offsetting curves from the curve CI of 
Fig. 4. 

It has been found by utilisation of the above method that 
the result produced consists of a series of brush strokes which 
emanate from objects of interest within the image. 

Subsequent to covering the image with brush strokes of a 
given size, further processing steps can be undertaken with 
smaller and smaller brush strokes and increasing derivative 
threshold levels so as to more accurately "brush stroke" 
important features in the image. Such a technique is similar 
to that used by van Gogh in certain portions of his images 
where details are required. 

It would be appreciated by a person skilled in the art 
that numerous variations and/or modifications may be made to 
the present invention as shown in the specific embodiment 
without departing from the spirit or scope of the invention as 
broadly described. The present embodiment is, therefore, to be 
considered in all respects to be illustrative and not 
restrictive . 
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Ink Jet Technologies 

The embodiments of the invention use an ink jet printer 
type device. Of course many different devices could be used. 
However presently popular ink jet printing technologies are 
unlikely to be suitable. 

The most significant problem with thermal Inkjet is power 
consumption. This is approximately 100 times that required for 
high speed, and stems from the energy-inefficient means of drop 
ejection. This involves the rapid boiling of water to produce a 
vapor bubble which expels the ink. Water has a very high heat 
capacity, and must be superheated in thermal inkjet 
applications. This leads to an efficiency of around 0.02%, from 
electricity input to drop momentum (and increased surface area) 
out . 

The most significant problem with piezoelectric inkjet is 
size and cost. Piezoelectric crystals have a very small 
deflection at reasonable drive voltages, and therefore require 
a large area for each nozzle. Also, each piezoelectric actuator 
must be connected to its drive circuit on a separate substrate. 
This is not a significant problem at the current limit of 
around 300 nozzles per print head, but is a major impediment to 
the fabrication of pagewide print heads with 19,200 nozzles. 

Ideally, the inkjet technologies used meet the stringent 
requirements of in-camera digital color printing and other high 
quality, high speed, low cost printing applications. To meet 
the requirements of digital photography, new inkjet 
technologies have been created. The target features include: 

low power (less than 10 Watts) 

high resolution capability (1,600 dpi or more) 
photographic quality output 
low manufacturing cost 

small size (pagewidth times minimum cross section) 
high speed (< 2 seconds per page) . 

All of these features can be met or exceeded by the inkjet 
systems described below with differing levels of difficulty. 45 
different inkjet technologies have been developed by the 
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Assignee to give a wide range of choices for high volume 
manufacture. These technologies form part of separate 

applications assigned to the present Assignee as set out in the 
table below. 

The inkjet designs shown here are suitable for a wide 
range of digital printing systems, from battery powered one- 
time use digital cameras, through to desktop and network 
printers, and through to commercial printing systems 

For ease of manufacture using standard process equipment, 
the print head is designed to be a monolithic 0.5 micron CMOS 
chip with MEMS post processing. For color photographic 
applications, the print head is 100 mm long, with a width which 
depends upon the inkjet type. The smallest print head designed 
is IJ3 8, which is 0.35 mm wide, giving a chip area of 3 5 square 
mm. The print heads each contain 19,200 nozzles plus data and 
control circuitry. 

Ink is supplied to the back of the print head by injection 
molded plastic ink channels. The molding requires 50 micron 
features, which can be created using a lithographically 
micromachined insert in a standard injection molding tool. Ink 
flows through holes etched through the wafer to the nozzle 
chambers fabricated on the front surface of the wafer. The 
print head is connected to the camera circuitry by tape 
automated bonding. 
Cross-Ref erenced Applications 

The following table is a guide to cross-referenced patent 
applications filed concurrently herewith and discussed 
hereinafter with the reference being utilized in subsequent 
tables when referring to a particular case: 



Docket 
No. 


Reference 


Title 


IJ01US 


IJ01 


Radiant Plunger Ink Jet Printer 


D02US 


IJ02 


Electrostatic Ink Jet Printer 


IJ03US 


IJ03 


Planar Thermoelastic Bend Actuator Ink Jet 


IJ04US 


IJ04 


Stacked Electrostatic Ink Jet Printer 


IJ05US 


D05 


Reverse Spring Lever Ink Jet Printer 


IJ06US 


IJ06 


Paddle Type Ink Jet Printer 


IJ07US 


IJ07 


Permanent Magnet Electromagnetic Ink Jet Printer 


IJ08US 


IJ08 


Planar Swing Grill Electromagnetic Ink Jet Printer 
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IJ09US 


IJ09 


Pump Action Refill Ink Jet Printer 


IJ10US 


IJ 10 


Pulsed Magnetic Field Ink Jet Printer 


IJ1 1US 


[J 11 


Two Plate Reverse Firing Electromagnetic Ink Jet Printer 


IJ12US 


[J 12 


Linear Stepper Actuator Ink Jet Printer 


IJ13US 


IJ13 


Gear Driven Shutter Ink Jet Printer 


IJ14US 


[J 14 


Tanered Magnetic Pole Electromagnetic Ink Jet Printer 


U 1 5US 


[J 15 


Linear Snrins? Electromagnetic Grill Ink Jet Printer 


I J 1 6US 


[J16 


Eorenz Oianhra^m Electromagnetic Ink Jet Printer 


TT17T JS 

XJ 1 / 


[J 17 


PTFF Surface Shooting Shuttered Oscillating Pressure Ink Jet 
Printer 


IJ18US 


IJ18 


Buckle Grip Oscillating Pressure Ink Jet Printer 


IJ19US 


IJ19 


Shutter Based Ink Jet Printer 


IJ20US 


IJ20 


Curling Calyx Thermoelastic Ink Jet Printer 


IJ21US 


IJ21 


Thermal Actuated Ink Jet Printer 


IJ22US 


IJ22 


Iris Motion Ink Jet Printer 


IJ23US 


IJ23 


Direct Firing Thermal Bend Actuator Ink Jet Printer 


IJ24US 


IJ24 


Conductive PTFF Ben Activator Vented Ink Jet Printer 




IJ25 


Ma^netostricti ve Ink let Printer 


IJ26US 


IJ26 


Shape Memory Alloy Ink Jet Printer 


TT97T T<\ 




Rnrkl^ Plate Ink let Printer 

D Uv_- IVJ £ iuLL/ X11JN. J \^ I 1 1 111 Lis I 




JLJ Z.O 


Thermal PlaQtif Rotarv Tmnpllpr Ink let Printpr 

i li^iiiitu jL/1«.>li^ i\u Ldi y iiiij_/*^ii^i xnrv jli i innwi 


TJ29US 


LI29 


Thermoelastic Bend Actuator Ink Jet Printer 


1JJUUO 


ino 

JLJ _>v/ 


Thermoplastic Bend Actuator Ilsinp PTFF and Corrugated Conner 

JL llt/1 lliVJt^ldoLlv^ JLJ V— '1 flv LU Cllwl v^J>lll^ JL X. X 1 j CU1U v/WllU^CllVyU V-^v/JLj'^C'I 

Ink Jet Printer 


J. J J 1 U J 


TR1 

±j — ' i 


RpnH Artuator Oirept Tnk Snnnlv Ink let Printer 


TH9T N 


in? 


A Hicrrt YfiiinaV \A r*H nl 1 1 vi THerrnoel a Qtip Tnk let Printer 

f \ Illgll 1 vJUll£^ o IVlv/LlUlU^ 1 iltl HHJt-lClOllV^ lllfv JV_/l I lllll^l 


THETIS 


ij j j 


Xhermallv ar*tnateH <;lr»tteH phamrier wall ink iet nrinter 

1 lit/1 lllCXllV ClwLLlCllV/vl olv^LLk^-VJ- Vvl lCU.1 W Clll 111IV Jvvt LJllllL^l 




TH4 


TnV Tet Printer having a thermal actuator romnrKiri^ an external 

Xllrv JLl JT lllllv-'l 11U. V Hit CI Lllv^lllICll C1^LL4CILW1 I JlUC, till V^ALWl 11C11 

coiled snrincr 


TJ35US 


IJ35 


Trough Container Ink Jet Printer 


IJ36US 


IJ36 


Dual Chamber Single Vertical Actuator Ink Jet 


IJ371JS 


IJ37 


Dual Nozzle Single Horizontal FulcRim Actuator Ink Jet 

3l** 1 1 V£jZj1V/ ky UltllV X X. V/l 1 Jtj vl 1 lUl JL Ulvl Will i. IvlUUlVl All IV *J I. 


IJ38US 


IJ38 


Dual Nozzle Single Horizontal Actuator Ink Jet 




THQ 


A cinole HenH nr'tiiiitr^r ninnpH n^irlrlle i x\ \c if*t r>nntincr Hevir'e 

>Ill^lV3 (JCHvi uL/LUalUl ^UJJJJtU jJclV-lLllt/ IIIjX |Cl |JlllllIllg UvVlLt/ 


T MOT T<\ 


1JHVJ 


A thermiillv ar'tn^teH \r\\c iet nrinter havincr n *;eriet nf thermal 
r\ L11CI lllcliiy dvvlUctLCLl 11 IN. JCl piilllCi llavlll^ cl ?»d ICS Ul LUCllllcu 

aptnator unit*; 

ClVv t LI Clt Wl HI 11 


TI411JS 

JLJ i 1 w O 


IJ41 


A thermal Iv actuated ink iet nrinter including a tanered heater 
element 


IJ42US 


IJ42 


Radial Back-Curling Thermoelastic Ink Jet 


IJ43US 


IJ43 


Inverted Radial Back-Curling Thermoelastic Ink Jet 


IJ44US 


IJ44 


Surface bend actuator vented ink supply ink jet printer 


IJ45US 


IJ45 


Coil Acutuated Magnetic Plate Ink Jet Printer 



Tables of Drop -on -Demand Inkjets 

Eleven important characteristics of the fundamental 
operation of individual inkjet nozzles have been identified. 
These characteristics are largely orthogonal, and so can be 
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elucidated as an eleven dimensional matrix. Most of the eleven 
axes of this matrix include entries developed by the present 
assignee . 

The following tables form the axes of an eleven 
dimensional table of inkjet types. 
Actuator mechanism (18 types) 
Basic operation mode (7 types) 
Auxiliary mechanism (8 types) 

Actuator amplification or modification method (17 types) 
Actuator motion (19 types) 
Nozzle refill method (4 types) 

Method of restricting back-flow through inlet (10 types) 
Nozzle clearing method (9 types) 
Nozzle plate construction (9 types) 
Drop ejection direction (5 types) 
Ink type (7 types) 

The complete eleven dimensional table represented by these 
axes contains 36.9 billion possible configurations of inkjet 
nozzle. While not all of the possible combinations result in a 
viable inkjet technology, many million configurations are 
viable. It is clearly impractical to elucidate all of the 
possible configurations. Instead, certain inkjet types have 
been investigated in detail. These are designated IJ01 to IJ45 
above . 

Other inkjet configurations can readily be derived from 
these 45 examples by substituting alternative configurations 
along one or more of the 11 axes. Most of the IJ01 to IJ45 
examples can be made into inkjet print heads with 
characteristics superior to any currently available inkjet 
technology. 

Where there are prior art examples known to the inventor, 
one or more of these examples are listed in the examples column 
of the tables below. The IJ01 to IJ45 series are also listed in 
the examples column. In some cases, a printer may be listed 
more than once in a table, where it shares characteristics with 
more than one entry . 
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Suitable applications include: Home printers, Office 
network printers, Short run digital printers, Commercial print 
systems, Fabric printers, Pocket printers, Internet WWW 
printers, Video printers, Medical imaging, Wide format 
printers, Notebook PC printers, Fax machines, Industrial 
printing systems, Photocopiers, Photographic minilabs etc. 

The information associated with the aforementioned 11 
dimensional matrix are set out in the following tables. 
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Ink Jet Printing 

A large number of new forms of ink jet printers have been 
developed to facilitate alternative ink jet technologies for the 
image processing and data distribution system. Various 
5 combinations of ink jet devices can be included in printer 
devices incorporated as part of the present invention. 
Australian Provisional Patent Applications relating to these ink 
jets which are specifically incorporated by cross reference 
include : 



Australian 
Provisional 
Number 


Filing Date 


1 itle 


PO8066 


15-Jul-97 


Image Creation Method and Apparatus (IJ01) 


PO8072 


15-JuI-97 


Image Creation Method and Apparatus (IJ02) 


PO8040 


15-Jul-97 


Image Creation Method and Apparatus (IJ03) 


PO8071 


15-Jul-97 


Image Creation Method and Apparatus (IJ04) 


PO8047 


15-Jul-97 


Image Creation Method and Apparatus (IJ05) 


PO8035 


15-Jul-97 


Image Creation Method and Apparatus (IJ06) 


PO8044 


15-Jul-97 


Image Creation Method and Apparatus (IJ07) 


PO8063 


15-Jul-97 


Image Creation Method and Apparatus (IJ08) 


PO8057 


15-Jul-97 


Image Creation Method and Apparatus (IJ09) 


PO8056 


15-Jul-97 


Image Creation Method and Apparatus (IJIO) 


PO8069 


15-Jul-97 


Image Creation Method and Apparatus (IJ1 1) 


PO8049 


15-Jul-97 


Image Creation Method and Apparatus (IJ12) 


PO8036 


15-Jul-97 


Image Creation Method and Apparatus (IJI3) 


PO8048 


15-Jul-97 


Image Creation Method and Apparatus (IJ14) 


PO8070 


15-Jul-97 


Image Creation Method and Apparatus (IJ15) 


PO8067 


15-Jul-97 


Image Creation Method and Apparatus (IJ16) 


PO8001 


15-Jul-97 


Image Creation Method and Apparatus (IJ17) 


PO8038 


15-Jul-97 


Image Creation Method and Apparatus (IJ 1 8) 


PO8033 


15-Jul-97 


Image Creation Method and Apparatus (IJ 1 9) 


PO8002 


15-Jul-97 


Image Creation Method and Apparatus (IJ20) 


PO8068 


15-Jul-97 


Image Creation Method and Apparatus (IJ21) 


PO8062 


15-Jul-97 


Image Creation Method and Apparatus (IJ22) 


PO8034 


15-Jul-97 


Image Creation Method and Apparatus (IJ23) 


PO8039 


15-Jul-97 


Image Creation Method and Apparatus (IJ24) 


PO804I 


15-Jul-97 


Image Creation Method and Apparatus (IJ25) 


PO8004 


15-JuI-97 


Image Creation Method and Apparatus (IJ26) 



A QTO/ s * c; 
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rUoUJ / 


1 j-JuJ-y / 


Image Creation Method and Apparatus (IJ27) 






Image Creation Method and Apparatus (IJ28) 


Jr UOWZ, 


1 S Till Q7 


Image Creation Method and Apparatus (IJ29) 




1 <n Tnl 07 


Image Creation Method and Apparatus (IJ30) 




no c^»-. Q7 


Image Creation Method and Apparatus (IJ31) 


rKJyjy 1 


11 C^r^ Q7 

Zj-oQp-y 1 


Image Creation Method and Apparatus (IJ32) 


DDHQQQ 

rrUooo 


1 ^ F\^^ 07 

Iz-Uec-y / 


Image Creation Method and Apparatus (IJ33) 


DDAQO 1 


lZ-uec-y I 


Image Creation Method and Apparatus (IJ34) 


DDf\QQA 

JrrUoVU 


1 z-Dec-y / 


Image Creation Method and Apparatus (IJ35) 


rrUo/J 


1 O T^^^ Q7 

I z-Dec-y / 


Image Creation Method and Apparatus (IJ36) 




1 O F\£i^ 07 

i z-jjec-y / 


Image Creation Method and Apparatus (IJ37) 




i z-Uec-y / 


Image Creation Method and Apparatus (IJ38) 


DD 1 IOC 


lO Ion no 


An Image Creation Method and Apparatus (IJ39) 


Dm coo 

YYZjyZ 


25-Mar-98 


An Image Creation Method and Apparatus (IJ40) 




jL Jt IVlcll 7U 


linage L,icduon iviciriou aiiu /\ppardius ^IJH- 1 ) 


PP3991 


9-Jun-98 


Image Creation Method and Apparatus (IJ42) 


PP3987 


9-Jun-98 


Image Creation Method and Apparatus (IJ43) 


PP3985 


9-Jun-98 


Image Creation Method and Apparatus (IJ44) 


PP3983 


9-Jun-98 


Image Creation Method and Apparatus (IJ45) 



Ink Jet Manufacturing 

Further, the present application may utilize advanced 
semiconductor fabrication techniques in the construction of large 
5 arrays of ink jet printers. Suitable manufacturing techniques 
are described in the following Australian provisional patent 
specifications incorporated here by cross-reference: 



Australian 
Provisional 
Number 


Filing Date 


Title 


P07935 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM01) 


P07936 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM02) 


P07937 


15-JuI-97 


A Method of Manufacture of an Image Creation Apparatus (IJM03) 


PO8061 


15-JuI-97 


A Method of Manufacture of an Image Creation Apparatus (IJM04) 


PO8054 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM05) 


PO8065 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM06) 


PO8055 


15-JuI-97 


A Method of Manufacture of an Image Creation Apparatus (IJM07) 


PO8053 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM08) 


PO8078 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM09) 
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r \_s r yjtjy 


1 S-Tnl-Q7 

1 ~j j ui y 1 


/\ iviciiiuu ui ividiiuiciLiurc ui dn lmdge creation Apparatus ^iJlviiuj 


r yj / 7JU 


1 ^ Till Q7 


A Method of Manufacture of an Image Creation Apparatus (IJM1 1) 


P07QAQ 


1 ^ Tnl Q7 


/\ ivieinoa or lVianuraciure or an image creation Apparatus (1JM IZ) 




1 S Tnl 07 


a ivieinoa or ivianuiaciure or an image creation Apparatus vlJM \j) 


POKOSQ 
1WOUJ7 


1 S Tut 07 


a ivieinoa or ivianuiaciure or an image creation Apparatus ^U1V1I4,| 


PO&07^ 


1 ^-Tnl-07 

1 ~J J HI y 1 


r\ ivicinuu ui lvidiiui acLuic ui dii lnidgc i^rediion Appdraius ^iJivii o) 


POR076 


1 ~J JUI y / 


/-v iviciiiuu ui ividiiui dciurc 01 an image v^reanon Apparatus ^iJiviio^ 


POS07S 


1 S Tnl 07 


a ivieinou 01 ivianuiaciure 01 an image creation Apparatus (IJIVII / ) 


pn&n7Q 

rVJoU / y 


1 <\ Tnl 07 


a iviernou or ivianuracture or an image creation Apparatus (IJM \ o) 




1^ Tnl Q7 
1 J-JUI-7 / 


A Method of Manufacture of an Image Creation Apparatus (IJM 19) 


POfifK7 
rUoUJZ 


1 < Jul Q'7 


A Method of Manufacture of an Image Creation Apparatus (IJM20) 


PO70A8 


1 ^ Tnl Q7 


A Method of Manufacture of an Image Creation Apparatus (IJM21) 


rU / 1 


1 ^ !„! 07 

1 j-jui-y / 


A Method of Manufacture of an Image Creation Apparatus (IJM22) 




1 ^ Tnl Q7 
1 J-JU1-V / 


A Method of Manufacture of an Image Creation Apparatus (IJM23) 




1 < Ji 1 1 07 
1 J-JUI-7 / 


A Method of Manufacture of an Image Creation Apparatus (IJM24) 


PO£H77 


|C T| 1 1 Q7 


A Method of Manufacture of an Image Creation Apparatus (IJM25) 




1 ^ lul 07 


A Method of Manufacture of an Image Creation Apparatus (IJM26) 


rUollj 1 


1 ^ in! m 


A Method of Manufacture of an Image Creation Apparatus (IJM27) 




1 <\ fut Q7 


A Method of Manufacture of an Image Creation Apparatus (IJM28) 




K T,,1 Q7 


A Method of Manufacture of an Image Creation Apparatus (IJM29) 


POftH/lA 


1 C T..1 07 


A Method of Manufacture of an Image Creation Apparatus (IJM30) 




11 A 11 rr Q7 

1 1 -/\ug- V / 


A Method of Manufacture of an Image Creation Apparatus (IJM30a) 




7^ Q7 

z.?-oep-y / 


A Method of Manufacture of an Image Creation Apparatus (IJM31) 


ncy^yz 


7^ <v«3.r-k Q7 


A Method of Manufacture of an Image Creation Apparatus (IJM32) 


rrUooV 


1 7 i^o/-. 07 
1 z-L/ec-v 1 


A Method of Manufacture of an Image Creation Apparatus (IJM35) 


rrUoo / 


1 7 l~V»r> Q7 

1 z-uec-y / 


A Method of Manufacture of an Image Creation Apparatus (IJM36) 


PPO&R7 


1 7 Q7 


A Method of Manufacture of an Image Creation Apparatus (IJM37) 


PPOR7zt 


17 n^r- 07 
i z-uec-7 / 


a metnoa 01 ivianuiacture or an image Creation Apparatus (iJMio) 


PP1 IQf* 


i y~j ctii-70 


a ivieinoa or ivianuracrure or an image creation Apparatus yijNijy) 


PP7^Q 1 


zj-iviar-yo 


A Method of Manufacture of an Image Creation Apparatus (IJM41) 


PP3989 


9-Jun-98 


A Method of Manufacture of an Tmacre Creation Ann;mihi<; ^TT\/T40^ 


PP3990 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM42) 


PP3986 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM43) 


PP3984 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM44) 


PP3982 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM45) 
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Fluid Supply 

Further, the present application may utilize an ink delivery 
system to the ink jet head. Delivery systems relating to the 
supply of ink to a series of ink jet nozzles are described in the 
5 following Australian provisional patent specifications, the 
disclosure of which are hereby incorporated by cross-reference: 



Australian 
Provisional 
Number 


Filing Date 


Title 


PO8003 


15-Jul-97 


Supply Method and Apparatus (Fl) 


PO8005 


15-Jul-97 


Supply Method and Apparatus (F2) 


PO9404 


23-Sep-97 


A Device and Method (F3) 



MEMS Technology 



Further, the present application may utilize advanced 
semiconductor microelectromechanical techniques in the 
0 construction of large arrays of ink jet printers. Suitable 
microelectromechanical techniques are described in the following 
Australian provisional patent specifications incorporated here by 
cross-reference : 



Australian 
Provisional 
Number 


Filing Date 


Title 


P07943 


15-JuI-97 


A device (MEMS01) 


PO8006 


15-Jul-97 


A device (MEMS02) 


PO8007 


15-Jul-97 


A device (MEMS03) 


PO8008 


15-Jul-97 


A device (MEMS04) 


PO8010 


15-Jul-97 


A device (MEMS05) 


PO801I 


15-Jul-97 


A device (MEMS06) 


P07947 


15-JuI-97 


A device (MEMS07) 


P07945 


15-Jul-97 


A device (MEMS08) 


P07944 


15-Jul-97 


A device (MEMS09) 


P07946 


15-Jul-97 


A device (MEMS 10) 


P09393 


23-Sep-97 


A Device and Method (MEMS 1 1) 


PP0875 


12-Dec-97 


A Device (MEMS 1 2) 


PP0894 


12-Dec-97 


A Device and Method (MEMS 13) 
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IR Technologies 

Further, the present application may include the utilization 
of a disposable camera system such as those described in the 
following Australian provisional patent specifications 
5 incorporated here by cross-reference: 





Australian 
Provisional 
Number 


Filing Date 


Title 




PP0895 


12-Dec-97 


An Image Creation Method and Apparatus (IRO 1 ) 




PP0870 


12-Dec-97 


A Device and Method (IR02) 




PP0869 


12-Dec-97 


A Device and Method (IR04) 




PP0887 


12-Dec-97 


Image Creation Method and Apparatus (IR05) 




PP0885 


12-Dec-97 


An Image Production System (IR06) 




PP0884 


12-Dec-97 


Image Creation Method and Apparatus (IR10) 




PP0886 


12-Dec-97 


Image Creation Method and Apparatus (IR12) 




PP0871 


12-Dec-97 


A Device and Method (IR13) 




PP0876 


12-Dec-97 


An Image Processing Method and Apparatus (IR14) 




PP0877 


12-Dec-97 


A Device and Method (IR16) 




PP0878 


12-Dec-97 


A Device and Method (IR17) 




PP0879 


12-Dec-97 


A Device and Method (IR18) 




PP0883 


12-Dec-97 


A Device and Method (IR19) 




PP0880 


12-Dec-97 


A Device and Method (IR20) 




PP0881 


12-Dec-97 


A Device and Method (IR21 ) 



DotCard Technologies 

Further, the present application may include the utilization 
10 of a data distribution system such as that described in the 
following Australian provisional patent specifications 
incorporated here by cross-reference: 



Australian 
Provisional 
Number 


Filing Date 


Title 


PP2370 


16-Mar-98 


Data Processing Method and Apparatus (DotOl) 


PP2371 


16-Mar-98 


Data Processing Method and Apparatus (Dot02) 
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Artcam Technologies 

Further, the present application may include the utilization 
of camera and data processing techniques such as an Artcam type 
device as described in the following Australian provisional 
patent specifications incorporated here by cross-reference: 



Australian 
Provisional 
Number 


Filing Date 


Title 


P07991 


15-Jul-97 


Image Processing Method and Apparatus (ARTO 1 ) 


PO8505 


1 l-Aug-97 


Image Processing Method and Apparatus (ARTO la) 


P07988 


15-Jul-97 


Image Processing Method and Apparatus (ART02) 


P07993 


15-Jul-97 


Image Processing Method and Apparatus (ART03) 


PO8012 


15-Jul-97 


Image Processing Method and Apparatus (ART05) 


PO8017 


15-JuI-97 


Image Processing Method and Apparatus (ART06) 


PO8014 


15-Jul-97 


Media Device (ART07) 


PO8025 


15-Jul-97 


Image Processing Method and Apparatus (ART08) 


PO8032 


15-Jul-97 


Image Processing Method and Apparatus (ART09) 


P07999 


15-Jul-97 


Image Processing Method and Apparatus (ART 10) 


P07998 


15-Jul-97 


Image Processing Method and Apparatus (ART1 1) 


PO803 1 


15-Jul-97 


Image Processing Method and Apparatus (ART 12) 


PO8030 


15-Jul-97 


Media Device (ART 13) 


P08498 


ll-Aug-97 


Image Processing Method and Apparatus (ART 14) 


P07997 


15-Jul-97 


Media Device (ART 15) 


P07979 


15-Jul-97 


Media Device (ART 1 6) 


PO8015 


1 5-Jul-97 


Media Device (ART 17) 


P07978 


15-Jul-97 


Media Device (ART 18) 


P07982 


15-Jul-97 


Data Processing Method and Apparatus (ART19) 


P07989 


15-Jul-97 


Data Processing Method and Apparatus (ART20) 


PO8019 


15-Jul-97 


Media Processing Method and Apparatus (ART21) 


PO7980 


15-Jul-97 


Image Processing Method and Apparatus (ART22) 


P07942 


15-Jul-97 


Image Processing Method and Apparatus (ART23) 


PO8018 


15-Jul-97 


Image Processing Method and Apparatus (ART24) 


P07938 


I5-Jul-97 


Image Processing Method and Apparatus (ART25) 


PO8016 


15-Jul-97 


Image Processing Method and Apparatus (ART26) 


PO8024 


15-Jul-97 


Image Processing Method and Apparatus (ART27) 


PO7940 


15-Jul-97 


Data Processing Method and Apparatus (ART28) 


P07939 


15-Jul-97 


Data Processing Method and Apparatus (ART29) 


PO8501 


ll-Aug-97 


Image Processing Method and Apparatus (ART30) 
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PO8500 


1 l-Aug-97 


Tmacrp Propepsin cr A/fpthod and Annaratns ^ART3D 


P07987 


15-Jul-97 


Data Processing Method and Annaratus fART"^^ 


PO8022 


15-Jul-97 


Image Processing Method and Apparatus (ART33) 


P08497 


1 l-Aug-97 


Image Processing Method and Apparatus (ART30) 


PO8029 


15-Jul-97 


Sensor Creation Method and Apparatus (ART36) 


P07985 


15-Jul-97 


Data Processing Method and Apparatus (ART37") 
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PO8020 


15-Jul-97 


Data Process sincr IVTethod and Annaratns ( ART^8^ 


PO8023 


1 5-Iul-97 


Data Prnrp<iQinc* Mpthod and Annaratus ( ART^QA 


P09395 


?3-Sen-97 

£**J OWL' V / 


Data Propp^sincr Method and Annaratus fART4^ 
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PO802 1 


I5-Jul-97 


Data Processing Method and Apparatus (ART40) 


PO8504 


1 l-Aug-97 


Tmaoe Processing Method and Annaratus ^ART42"i 


PO8000 


15-Jul-97 


Data Prnrp^^incr l^/Teth nd ;md Annaratns ( ART4^ 


PQ7977 

i \y / y i t 


1 S-Tul-97 

1 J J Ul si 


Data Pro^p coiner \/Tpthod Mnd Ann^ratnvi ( ARTttJ.^ 


PD79^4 


1 S-Tul-97 

I *J J HI 17 / 
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PO7990 

IT \y l y y\J 


1 S-Tul-97 
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P07981 


I5-JuI-97 


Data Propepsin cr IVfpthn^l and Annaratns ( ARTSO^ 


P07986 


15-Jul-97 


Data Proce^^inc*' N/Tethod and Annaratns f ARTS 1^1 




1 S-Tul-97 


Oata Prrippccincx \/fpthnH and AnnjirntiK ( ARTS9^ 
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PO8027 
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P09394 


23-Sep-97 


Imacrp Prf^reKviincF K/Tethnd and Annaratns ( ARTS7^ 
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P09396 


23-Sep-97 
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Data Processing Method and Apparatus (ART64) 


PO9403 


23-Sep-97 


Data Processing Method and Apparatus (ART65) 


PO9405 


23-Sep-97 


Data Processing Method and Apparatus (ART66) 


PP0959 


16-Dec-97 


A Data Processing Method and Apparatus (ART68) 


PP1397 


19-Jan-98 


A Media Device (ART69) 
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We Claim : 

1. A method of automatically processing an image 
comprising locating within the image features having a high 
spatial variance and stroking the image with a series of brush 

5 strokes emanating from those areas having high spatial variance. 

2. A method as claimed in claim 1 wherein said brush 
stroke have decreasing sizes near important features of the 
image . 

3. A method as claimed in claim 1 wherein said brush 
0 strokes include opacity and bump maps for added realism. 

4. A method as claimed in claim 1 wherein the position of 
a predetermined portion of brush strokes undergoes random 
j ittering . 
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Abstract 

Method is disclosed for the automatic creation of images in 
a "van Gogh" style. The method comprises locating portions of 
detail in an image an utilising the areas of detail to propagate 
5 brush strokes into areas of the image having lesser details. A 
number of modifications are also proposed including utilising 
refining brush strokes to process those areas of detail in an 
image . 
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